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Abstract 

We consider a modulated process S which, conditional on a background process X, 
has independent increments. Assuming that S drifts to — oo and that its increments 
(jumps) are heavy-tailed (in a sense made precise in the paper), we exhibit natural con- 
ditions under which the asymptotics of the tail distribution of the overall maximum of S 
can be computed. We present results in discrete and in continuous time. In particular, 
in the absence of modulation, the process S in continuous time reduces to a Levy process 
with heavy-tailed Levy measure. A central point of the paper is that we make full use 
of the so-called "principle of a single big jump" in order to obtain both upper and lower 
bounds. Thus, the proofs are entirely probabilistic. The paper is motivated by queueing 
and Levy stochastic networks. 
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1 Introduction 

This paper deals with the study of the asymptotic distribution of the maximum of a random 
walk S on the real line R, modulated by a regenerative process, when the increments have 
heavy-tailed distributions. (By "modulated" we mean that, conditional on some background 
process, S becomes a process with independent increments.) Our goals are (a) to generalise 
and unify existing results, (b) to obtain results for continuous-time modulated random walks, 
and (c) to simplify proofs by making them entirely probabilistic, using what we may call 
the principle of a single big jump, namely the folklore fact that achieving a high value of 
the maximum of the random walk is essentially due to a single very large jump. Indeed, 
we manage to translate this principle into rigorous statements that make the proofs quite 
transparent. 

Throughout the paper, by "tail" we mean exclusively "right tail", except where otherwise 
explicitly stated. By a heavy-tailed distribution we mean a distribution (function) G on R 
possessing no exponential moments: e sy G(dy) = oo for all s > 0. Such distributions not 
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only abound in theory, but are also useful in modern probabilistic modelling, in such diverse 
areas as insurance risk, communication networks, and finance. 

For any distribution function G on R, we set G(y) := 1 — G(y) and denote by G* n the n-fold 
convolution of G by itself. 

A distribution G on R + belongs to the class S of subexponential distributions if and only 
if, for all n > 2, we have lim^oo G* n (y) /G(y) = n. (It is sufficient to verify this condition 
in the case n = 2 — see Chistyakov (1964).) This statement is easily shown to be equivalent 
to the condition that, if Y\, . . . , Y n are i.i.d. random variables with common distribution G, 
then 

P{Y l + • • • + Y n > y) ~ P(max(y 1 , . . . ,Y n ) > y), 

a statement which already exemplifies the principle of a single big jump. (Here, and else- 
where, for any two functions /, g on R, by f(y) ~ g{y) as y — ► oo we mean lim^oo f(y) / g(y) = 
1; we also say that / and g are tail- equivalent. We also write f(y) < g(y) as y — > oo if 
lim^^oo f(y)/g(y) < 1.) The class S includes all the heavy-tailed distributions commonly 
found in applications, in particular regularly-varying, lognormal and Weibull distributions. 

If G\ and G2 are distributions on R + such that G\ € S and G2(y) ~ cG\(y) as y — > 

00 for some constant c > 0, then also G2 G 5 — see Kliippelberg (1988). In particular, 
subexponentiality is a tail property, a result of which we make repeated implicit use below. 
It is thus natural to extend the definition of subexponentiality to distributions G on the 
entire real line R by defining G € S if and only if G + G S where G + {y) = G(y)l(y > 0) and 

1 is the indicator function. Some further necessary results for subexponential distributions 
are given in the Appendix. 

We define also the class C of long-tailed distributions on R by G € C if and only if, for all c, 
G(y + c) ~ G(y) as y — > 00 (it is sufficient to verify this for any nonzero c). It is known that 
S C £ and that any distribution in C is heavy-tailed — see Embrechts and Omey (1982). 
Good surveys of the basic properties of heavy-tailed distributions, in particular long-tailed 
and subexponential distributions, may be found in Embrechts et al. (1997) and in Asmussen 
(2000). 

For any distribution G on R with finite mean, we define the integrated (or second) tail 
distribution (function) G 1 by 

&(y) = 1 - G I (y) := min (l, G(z) dz^j . 

Note that G € C implies that G 1 € C, but not conversely. 

Let (£ n , n > 1) be a sequence of i.i.d. random variables with common distribution F on R 
and define the random walk (S n , n > 0) by S n = J27=i f° r eacn n > (with the convention 
here and elsewhere that a summation over an empty set is zero, so that here So = 0). Define 
M := sup ra >Q S n . A now classical result (Pakes (1975), Veraverbeke (1977), Embrechts and 
Veraverbeke (1982)), which we henceforth refer to as the Pakes- Veraverbeke's Theorem, 
states that if F 1 G S and if a := —E^\ > (so that in particular M is a.s. finite) then 

P(M > y) ~ -F\y) as y -» 00. (1) 
a 

(Again it is the case that for most common heavy-tailed distributions F, including those 
examples mentioned above, we have F l G S.) The intuitive idea underlying this result is 
the following: the maximum M will exceed a large value y if the process follows the typical 
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behaviour specified by the law of large numbers, i.e. it's mean path, except that at some one 
time n a jump occurs of size greater than y + na\ this has probability F(y + na); replacing 
the sum over all n of these probabilities by an integral yields (fT|): this again is the principle 
of a single big jump. See Zachary (2004) for a short proof of ^ based on this idea. 

In the first part of the paper (Section^ we consider a sequence (£ n , n > 1) of random 
variables which, conditional on another process X = (X n , n > 1), are independent, and 
which further are such that the conditional distribution of each £ n is a function of X n 
and otherwise independent of n. We then talk of the partial sums S n := Y27=i£i as a 
modulated random walk. (In fact our framework includes a variety of apparently more 
general processes, e.g. Markov additive processes — see Remark 12.11 ) Our aim is to obtain 
the appropriate generalisation of the result ([T|). We give references to earlier work below. 

We need to assume some asymptotic stationarity for the background process X which we 
take to be regenerative. A particular case of this is when X is an ergodic Markov chain. We 
also suppose that the conditional distributions F x given by F x (y) := P(£ n < y \ X n = x) 
have tails which are bounded by that of a reference distribution F such that F 1 £ S. We 
then show (in Theorem 12.11) that, in the case where the distributions F x (when truncated 
sufficiently far below) have means which are uniformly negative, then, under very modest 
further regularity conditions, the result Q continues to hold with 1/a replaced by C/a. 
Here —a < is now the average (with respect to the stationary distribution of X) of the 
above means and the constant C measures the average weight of the tail of F x with respect 
to that of F. (The condition —a < is sufficient to ensure that M is a.s. finite.) In the more 
general case where the distributions F x have means of arbitrary sign, but where —a defined 
as above continues to be negative, we show (in Theorem 12. 2[) that the result continues to 
hold, with 1/a replaced by C/a as above, provided that an appropriate condition is imposed 
on the tail of the distribution of the lengths of the regenerative cycles of the process X. We 
give an example to show the necessity of this condition. Our proofs follow the probabilistic 
intuition of a single big jump as defined above. One key idea, encapsulated in a very general 
result given in Section 12.21 and applicable to a wide class of processes with independent 
heavy-tailed increments, is to use the result Q of the Pakes-Veraverbeke Theorem itself: 
the extremes of the increments of the general process may be bounded by those of an 
unmodulated random walk, whose increments are i.i.d. with negative mean; the fact that an 
extreme value of the supremum of the latter process may only be obtained via a single big 
jump ensures the corresponding result for the modulated process. Indeed we only ever use 
the condition F l E S in the application of the Pakes-Veraverbeke Theorem (though we make 
frequent of use the weaker condition F 1 € C). A preliminary version of the discrete-time 
theory was given in Foss and Zachary (2002). The present treatment is considerably simpler 
and more unified, and results are obtained under weaker conditions which are, in a sense, 
demonstrated in Example 12.11 optimal. 

We mention several papers on the tail asymptotics of a the supremum of a discrete-time 
modulated random walk with heavy-tailed increments. Arndt (1980) considers increments 
with regularly varying tails modulated by a finite-state-space Markov chain. Alsmeyer and 
Sgibnev (1999) and, independently, Jelenkovic and Lazar (1999) also consider a finite state 
space Markov chain as the modulating process, and assume that the increments of the 
modulated process have a subexponential integrated tail. Note that, for a finite Markov 
chain, the cycle length distribution has an exponential tail. Asmussen (1999) considers a 
modulated random walk with an exponentially bounded distribution of the cycle length, 
and assumes that both the tails and the integrated tails of the increments of the modulated 



3 



process have sub exponential distributions. Asmussen and M0ller (1999) and Asmussen 
(1999) also consider a random walk with another type of modulation. 

Hansen and Jensen (2005) study the asymptotics of the maximum of a modulated process 
on a finite random time horizon. We also mention a number of related papers on queueing 
systems whose dynamics may be viewed as a kind of multi-dimensional random walk with a 
special type of modulation. Baccelli, Schlegel, and Schmidt (1999) and Huang and Sigman 
(1999) consider a special type of modulation which occurs in tandem queues and in their 
generalisations, and find asymptotic results under the assumption that the tail distribution 
of one of the service times strictly dominates the remainder. A general approach to the 
asymptotic study of monotone separable stochastic networks is given by Baccelli and Foss 
(2004), see also Baccelli, Foss and Lelarge (2004, 2005) for further applications. 

In the second part of the paper (Section EJ), we consider the supremum of modulated 
continuous-time random walk, whose jumps are similarly heavy-tailed. The modulated 
continuous-time random walk is defined as a process (St, t > 0) which, conditional on a 
regenerative process (Xt, t > 0) has independent increments, i.e. its characteristic func- 
tion is given by the Levy-Khinchine formula. The parameters of the process entering the 
Levy-Khinchine formula are therefore themselves measurable functions of the background 
regenerative process. In the absence of the background process, (St, t > 0) becomes a Levy 
process. Under conditions analogous to those for the discrete-time theory, we establish sim- 
ilar results for the asymptotic tail distribution of the supremum of the process (St, t > 0). 
The continuous-time theory quite closely parallels the discrete (and we make every attempt 
to keep the two developments as similar as possible): there are, however, some additional 
technicalities concerned with the "small jumps" and diffusion components of the continuous- 
time process — these do not contribute to the heavy-tailed distribution of the supremum; in 
compensation some aspects of the theory are simpler than in discrete time. In particular, 
the proof of the lower bound in continuous-time requires the use of a (modulated) Poisson 
point process in a way that is similar to the methods of Konstantopoulos and Richard- 
son (2002). Again we require a result, given in Section 13.31 for a fairly general class of 
processes with independent heavy-tailed increments. The specialisation of this result, un- 
der appropriate conditions, to an (unmodulated) Levy process gives a simple proof of the 
continuous-time version of the Pakes-Veraverbeke Theorem, different from that found in the 
existing literature — see, e.g., Kluppelberg, Kyprianou and Mailer (2004) and Maulik and 
Zwart (2005). 

Some words on motivation: heavy-tailed random variables play a significant role in the 
mathematical modeling of communication networks because the variety of services offered 
by a huge system such as the Internet results in heterogeneous traffic. Part of the traffic con- 
cerns small requests but other parts pose significant burden to the system resulting in huge 
delays and queues. Models of networks based on Levy processes-see, e.g., Konstantopoulos, 
Last and Lin (2004) -are natural analogues of the more-traditional Brownian networks of 
production and service systems. To date, however, no results for the stationary distribution 
of the load of stations in isolation are available. Our paper represents a first step towards 
this goal. Indeed, in a Levy stochastic network of feedforward type, one may see a down- 
stream node as being in the "background" of a previous node. To apply the results of this 
paper to Levy stochastic networks is beyond its scope and is left to a future work. 

The Appendix gives some results, known and new, for the addition of sub exponential ran- 
dom variables, together with some other complements to the main theory. In particular 
Lemma IA.2I extends a well-known result for the sum of independent sub exponential ran- 
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dom variables (Lemma IA.1|) to those which have an appropriate conditional independence 
property, and is of independent interest. 



2 Modulated random walk in discrete time 
2.1 Introduction and main results 

Consider a regenerative process X = (X n ,n > 1) such that, for each n, X n takes values 
in some measurable space (X, JT). We say that the random walk (S n , n > 0), defined by 
So = and S n = £], + ■•• + £« for n > 1, is modulated by the process X if 

(i) conditionally on X, the random variables £ n , n > 1, are independent, 

(ii) for some family (F x , x G X) of distribution functions such that, for each y, F x (y) is a 
measurable function of x, we have 

P{in <y\X) = P{i n <y\X n ) = F Xn (y) a.s. (2) 

Define 

M n := max(5o, $1, ■ ■ ■ > S n ), n>0, M:=sup5 n . 

n>0 

Under the conditions which we give below, S n — » — oo a.s. as n — > oo, and the random 
variable M is then nondefective. We are interested in deriving an asymptotic expression for 
P(M > y) as y — ► cxd. 

Remark 2.1. In fact nothing below changes if, in (j2j), we allow the distribution of £ n to 
depend on the history of the modulating process X between the last regeneration instant 
prior to time n and the time n itself. This possible relaxation can either be checked directly, 
or brought within the current structure by suitably redefining the process X. Thus in 
particular our framework includes Markov additive processes. 

The regeneration epochs of the modulating process X are denoted by < To < T\ < . . . . 
By definition, the cycles {(X n ,Tk-i < n < T^), k > 1) are i.i.d. and independent of the 
initial cycle (X n , < n < Tq). Define also tq := Tq and := T/~ — for k > 1, so 
that (rfe, k > 0) are independent and (t/%, k > 1) are identically distributed. Assume that 
En < oo. For each n > 0, let 7r ra be the distribution of X n , and define, as usual, the 
stationary probability measure 

EYj 1 t.i 1(X„ G 5) 

Each distribution F x , x £ X, will be assumed to have a finite mean 

Or := / yF x (dy). (3) 

The family of such distributions will be assumed to satisfy the following additional conditions 
with respect to some reference distribution F with finite mean and some measurable function 
c : X -> [0,1]: 

(Dl) F~ x {y) < F(y), for all y G R, x G AT, 
(D2) F%{y) ~ c(:c)F%) as y -> oo, x £ X, 

(D3) a := — I a x Tr{dx) is finite and strictly positive. 



5 



Remark 2.2. The condition (Dl) is no less restrictive than the condition 

- — F~{y) 

hm sup ■= < oo, 

v-*°°xeX F(y) 

in which case it is straightforward to redefine F, and then c, so that (Dl) and (D2) hold as 
above. 

Remark 2.3. A sufficient condition for (D2) to hold is that, for all x G X, we have F x {y) ~ 
c(x)F(y) as y — > oo. However, in order to obtain our main results we shall require Lemma [2.3l 
below to be established under the weaker condition (D2) as stated above. (The proof of 
Theorem 12.21 utilises the fact that, when F 1 G C as required there, the condition (D2) is 
preserved when any of the distributions F x is shifted by a constant. This is not true if 
(D2) is replaced by the strengthened version above, unless we further assume F G C — an 
assumption which we do not wish to make!) 

Remark 2.4. We impose no a priori restrictions on the signs of the a x , other than that given 
by the condition (D3). The latter condition is trivially satisfied in the case where all the 
a x are strictly negative. (The introduction of the minus sign in the definition of a is for 
convenience in the statement of our results.) 

It follows from the regenerative structure of X and from (Dl) and (D3), that 

S n /n — > —a as n — ► oo, a.s. (4) 
(See the Appendix for a proof of this result.) 

Thus, in particular, S n — > — oo as n — ► oo and M is nondefective as required. 
For each x G X and /3 > 0, define 

4 ■= ~ I \y + P) F *(dy) = ! {V V -0) F x (aly); (5) 

note that a x > a x . Define also 

k := lim sup a x . (6) 

(l^oo xeX 

Note that, from (j5J) and the condition (Dl), k is a real number between —a and //, where ji 
is the mean of the reference distribution F. In the case where the distributions F x , x G X, 
satisfy the uniform integrability condition 

-/9 



lim sup / \y\ F x (dy) = 0, 

>-+°°xiEX J-oo 



we have k = sup x( z X a x . 
Define also C G [0, 1] by 

C:= / c{x)Tr(dx). (7) 
Theorem 12 . 1 1 b elow gives our main result in the case k < 0. 

Theorem 2.1. Suppose that (Dl)-(DS) hold, that F l G 5, and that n < 0. T/ien 

Km > »> = °. 

y^oo F 1 (y) a 
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In order to extend Theorem [23 to the case where the sign of k may be arbitrary, we require 
an additional condition regarding the (tail) distributions of the lengths of the regenerative 
cycles. The condition we need is: 

(D4) For some nonnegative b > k, 

P(br >n) = o(F*(n)), P(bn > n) = o(F(n)), as n -> oo. (8) 

Note that if (jHJ) is satisfied for some nonnegative b, then it is also satisfied for any smaller 
value of b. In the case k < the condition (D4) is always trivially satisfied by taking 6 = 0. 
Hence Theorem 12.11 is actually a special case of the general result given by Theorem 12.21 
below. 

Theorem 2.2. Suppose that (D1)-(D4) hold and that F 1 G S. Then 

y^oo F 1 {y) a 
In Section 12.41 we give an example to show the necessity of the assumption (D4) . 

2.2 A uniform upper bound for discrete-time processes with independent 
increments 

Our proofs require several uses of the following proposition, which is new and may be of 
independent interest. This, under appropriate conditions, provides an upper bound for the 
distribution of the supremum of a random walk with independent increments. This bound is 
not simply asymptotic and further has an important uniformity property. No regenerative 
structure is assumed, and the result is therefore of independent interest. 

Proposition 2.1. Let F be a distribution function on R such that J °° F(y)dy < oo and 
whose integrated tail F 1 G S. Let a, (3 be given positive real numbers. Consider any se- 
quence (£ n , n > 1) of independent random variables such that, for each n, the distribution F n 
of in satisfies the conditions 

K(y) < F{y) for all y G R, (9) 

/ (zV -(3) F n (dz) < -a. (10) 
Jr 

Let M := 

su Pn>o Si=i & • Then there exists a constant r depending on F, a and (3 only, 
such that, for all sequences (£ n , n > 1) as above, 

P(M >y)< rF^{y) for all y. (11) 

Proof. Consider any sequence (£ n , n > 1) as above. We assume, without loss of generality, 
that £ n > —(3, a.s. for all n (for, otherwise, we can replace each £ n by max(^ n , —j3)). We now 
use a coupling construction. Let (U n , n > 1) be a sequence of i.i.d. random variables with 
uniform distribution on the unit interval (0, 1). For each n, let F~ l {y) = sup{z : F n {z) < y} 
be the generalised inverse of F n , and define similarly F -1 . Let 

i n :=F-\U n ), rj n := F~ l (U n ). 
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Then £ n has distribution F n , rj n has distribution F and £ n < rj n a.s. Choose a constant y* 
sufficiently large, such that 

m := E[rfrl(Tft > y*)] < a/4 and max(l,P)P(rn > y*) < a/4. (12) 

Let e = P(rji > y*) and let Kq = m/e + 1. For each n, define the random variables 

5 n := l( Vn > y*) (13) 

■= in{l ~ S n ) + K Q 5 n (14) 
Ipn ■= (fin ~ K )5 n . (15) 

Note that, from (|1U|>. (|12j l -p5 |) . and our assumption that ^ n > —(3, a.s., 

Etp n < E£ n + {13 + K )E5 n <-a+((3 + l)e + m< -a/4 (16) 

and 

E^ n = m - K e = -e < 0. (17) 

Note also that (5 n , n > 1) and (ip n , n > 1) are both sequences of i.i.d. random variables. 
For each n > 0, define Sn := V 9 * an d similarly St '■= ^27=1^- Define also M v := 

sup n>0 Sn and := sup ra>0 St- (It will follow below that M v and are almost surely 
finite.) From (|H|). lfT5)). and since £ n 7/ n a.s., it follows that, for each n, ^ n ^ cp n + ipn> 
and so 

M < sup(S^ + S%) < M v + M^. (18) 

n>0 

Given any realisation of the two sequences (5 n , n > 1) and (</? n , n > 1) such that J2 n = °°> 
the conditional distribution of coincides with that of the supremum of the partial sums 
of an i.i.d. sequence (t/j' n , n > 1) where 

P« e •) := P(r/! - ITo € ■ | tfi = 1). (19) 

It follows from (JT7J) that S^i = -1- 

Since Y2n^ n — 00 a - s -i ^ follows that the random 
variable is finite a.s. and does not depend on the joint distribution of the random 
variables (5 n ,(p n , n > 1). In particular, and M v are independent random variables. 
Further, since F 1 € S C C, it follows from ()19|) that the common distribution ify of the 
random variables ip' n satisfies F^(y) ~ F I (y)/e as y — > oo. Hence, by the Pakes-Veraverbeke 
Theorem, 

P(M^ > y) ~ -F^y) as y -> oo. (20) 

We now consider the tail distribution of and show that this is exponentially bounded. 
For each n, let Fn be the distribution of (p n . We show first how to choose a constant s, 
depending on F, a, f3 only, such that the process exp sSn is a supermartingale. For this we 
require that, for all n, 

1 f°° 

(e s *-l)F%(dz)<0. (21) 



s J — oo 

From (fl3|) . (|14jl. and our assumption that ip n > —j3 a.s., it follows that, for all n, 

\<Pn\ <K := max(f3,y*,K ). 
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From this, and the inequality e sz < 1 + sz + s 2 K 2 e sK , valid for any s > and for any z 
such that | z | < K, it follows that the left side of (|2*Tj) is bounded above by Eip n + sK 2 e sK , 
which, by is less than or equal to zero for any s > such that sK 2 e sK < —a/4. 

Thus we fix such an s, depending only on F, a, /3 as required. It now follows by the usual 
argument involving the martingale maximal inequality that, for y > 0, 

P(M V >y)< e' sy . (22) 

Let C be a random variable which has tail distribution e~ sy and which is independent of 
everything else. Since and are independent, it follows from ((18)) that 

P(M > y) < P(M^ + C > y). (23) 

Further, from Lemma |A. 11 

P(M^ +(>y) , P(M^ > y) 1 
hm = = hm = = -. 

j/^oo F I (y) y^oo F 1 (y) e 

and so there exists r such that, for all y > 0, 

P(M^ + (>y)< rPi(y). (24) 

Finally, note that the distributions of and £, and so also the constant r, depend on F, 
a and /? only, so that the required result now follows from (|23() and (|24|). □ 

2.3 Proofs of Theorems [2H] and E21 

We now return to the model and assumptions of Section \'2. II and prove our main results. 
We give first the following technical lemma, which will be required subsequently. 

Lemma 2.1. Suppose that F 1 G C and that d\, d2 are constants such that d 2 > 0. Then 

F{V + di + d 2 n) ~ -ir-F^iy) as y -» oo, (25) 

n>l 2 

and, for any real sequence 5 n such that 5 n [ 0, 

6 nF(y + d x + d 2 n) = o (F l {y)) as y -» oo. (26) 

n>l 

T/ie conditions (Dl) and (D2) further imply that 

/ Mdx)F x (y + dt + d 2 n) ~ -r^G/) as y ^ cx). (27) 

Proof. The results (|25() and (|26() are elementary consequences of the condition F 1 G £, and, 
in each case, the approximation of a sum by an integral. Detailed proofs may be found in Foss 
and Zachary (2002). We prove (|27|) under the assumption that the regenerative process X 
is aperiodic, so that the distance ||7r n — 7r|| between 7r n and 7r in the total variation norm 
tends to zero — the modifications required to deal with the periodic case are routine. Then 



/ TT n (dx)F x (y + d 1 +d 2 n)^^2 n(dx)F x {y + d 1 + d 2 n) as 

n>l^ X n>l^ X 



y -» OO, (28) 
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since the absolute value of the difference between the left and right sides of (|2"%|) is bounded 
by Ylm II 71 "™ ~~ 7r ll-^ ? (y + d\ + (fan), which, by iffify . is o [F I (y)) as y — > oo. Further, using the 
condition (Dl), for y sufficiently large that F l {y + d\) < 1, the right side of (|28j) is bounded 
above and below by 

— / ir(dx)Fj(y + d x ) and — / vr(a!x)F]~(y + d x + d 2 ) 

respectively. From the conditions (Dl), (D2) and the dominated convergence theorem, for 
any constant d, 

/ n(dx)F*(y + d) ~ F ! (y + d) ir(dx)c(x) as y — > oo. 
ja V# 

The result (|27|) now follows from the condition F 1 £ £ □ 

The following lemma gives an asymptotic lower bound for P(M > y). This result is also 
proved in Foss and Zachary (2002), but we give here for completeness a short, simplified 
proof — see also Zachary (2004). 

Lemma 2.2. Suppose that (Dl)-(DS) hold and that F l € £. Then 

P(M > y) > a 



y^oo 



F\y) ~ a 



Proof. Given e > 0, by the weak law of large numbers we may choose a constant Iq sufficiently 
large that if, for each n, we define l n = Iq + (a + e)n, then 

P(S n > -l n ) > 1 - e. (29) 

For any fixed y > and each n > 1, define A n := {M n _i < y, <SVt-i > —ln-i, £n > y + ln-i}- 
Since, conditional on the background process X, the random variables £ n are independent, 
it follows that 



P(A n ) = E[l({M n „x < y, S n -i > -/ n _!})F Xn (y + l n ^)] 



> E[F Xn {y + /„_!)] - P({M„_! > y} U {5 n _i < -Z„_i})F(y + Z n _ x ) (30) 



> E[F Xn (y + k-i)] - [P(M > y) + e]F(y + Z n _x), (31) 

where (|30[) follows from the condition (Dl) and (|31|) follows from Q29JI . Since also the events 
A n , n > 1, are disjoint and each is contained in the event {M > y}, it follows that 

P(M >y)>Y, EWxZiv + ln-i)} ~ [P(M >y) + e] ]T F(y + l n -i) 

n>l n>l 

= (i + o(1) )_^^(y) - (1 + o(l))[P(M > y) + (32) 

= ( 1 + °( 1 ))7T7^)' ( 33 ) 

as y — > oo, where (|32|) follows from Lemma 12.11 and (|33[) follows since P(M > y) — > as 

y — > oo. The required result now follows by letting e tend to zero. □ 
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Remark 2.5. As in the Pakes- Ver aver b eke Theorem for unmodulated random walks, the 
intuitive idea underlying the above result is the following: the maximum M will exceed 
a large value y if the process follows the typical behaviour specified by the law of large 
numbers, i.e. it's mean path, except that at any time n a jump occurs of size greater than 
y + na; this has probability E[Fx n (y + na)], and so the bound is now given by the use of 

(P7|). 

We shall argue similarly for the upper bound: if M exceeds a large value y then it must be 
the case that a single jump exceeds y plus the typical behaviour of the process. We now 
proceed to making this heuristic more precise. 

We consider first, in Lemma 12.31 below, the upper bound for the relatively simple case 
k < 0. This result may be combined with the lower bound of Lemma 12.21 to give the exact 
asymptotics in this case (Theorem 12. ip . We then use the result of Lemma 12.31 to extend 
the upper bound, in the proof of Theorem \2.2\ to general K, thereby obtaining the exact 
asymptotics in this case also. 

Lemma 2.3. Suppose that (D1)-(D3) hold, that F l G S, and that k < 0. Then 

^P(M>V) < C 
j/^oo F 1 (y) a 

Proof. For given (small) e > 0, and (large) uq > 0, for each n > define u n = u$ — (a — e)n. 
Define the stopping time 

a = inf{n > : S n > u n }. 
Since S n /n — > —a a.s., it follows that (for fixed e) 

P(a < oo) ^0 as no — > oo. (34) 

Note that S a and M a = maxo< n <o- S n are only defined on {a < oo}. Here, and elsewhere, 
we use the convention that any probability of an event involving random variables such 
as S a or M a is actually the probability of the same event intersected by {a < oo}, e.g. 
P{M a > y) := P{M a > y, a < oo). 

Since S n < u n for all n < a, we have, for y > no, 

{M a >y} = {S a >y} = {S a -t + > y} C {£, > y - n CT _ 1} }, 

and hence 



P(M a >y)= P(S a >y)<Yl P ^n >V- «n-l 

n=l 

oo „ 

= ir n (dx)F x (y - 



Un-l) 

n=l ° X 

~ — W(y), (35) 
a — e 

as y — > oo, where the last equivalence follows from Lemma 12. II 

Since k < it follows from ((HJ) that we can choose any a € (0, —k) and then (3 > sufficiently 
large that 

sup / (zV -0) F x (dz) < -a. (36) 
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On the set {a < 00} define the sequence of random variables n > 1) by = £ CT + n ; 
let M a — sup n >Q X^i=i • Conditional on the background process X and any finite value 
of <7, the sequence n > 1) consists of independent random variables which, from (j3(ij) . 
satisfy the conditions © and (jlU|) of Proposition 12.11 (with F, a and f3 as defined here). It 
therefore follows from that proposition that there exists r, depending on F, a and (3 only, 
such that, for all x, all finite n and all y > 0, 

P(M CT >y|X = £, cr = n)< rP*(y); (37) 

further, conditional onl = i and a = n, the random variables M CT and M ff are independent. 
Let M be a random variable, independent of all else, with tail distribution 

P(M > y) = 1 A rF 1 (y), (38) 

Observe that, for y > uq, we have M = + M CT = M CT + M CT . By conditioning on X and 
each finite value of a, it follows from (|37jl. (|38|) and the above conditional independence that 

P(M > y) = P{M a + M a >y,a < 00) 
< P(M CT + M > y, a < 00) 

= P(cr < oo)P(M CT + M > y I a < 00) (39) 

Also, from pHj). 

_ P(M ff >_y k < oc) < C ^_ 

s/^oo i?i( y ) - (a - e)P(cr < 00) 

From ((SHI), (EH, (H3), the independ ence of M from all else, and Lemma I A. 11 

- — P(M > y) n . , / C 

lim _ / / ; < P(a < 00 — r 

y^oo i^i(y) - \( a - e)P(a < 00) 

C 



o — e 



+ rP(a< 00). (41) 



It follows from (|34j) that as no — > 00 the second term on the right side of (|41|) tends to 0. 
The required result now follows on letting also e — > 0. □ 

Proof of Theorem \2.1\ This is now immediate from Lemmas 12.21 and 12.31 □ 

Proof of Theorem \2.°A Let nonnegative b > k be such that the condition (D4) holds. Choose 

5 G (0, min(a, b — k)) (42) 
and choose e £ (0, a — 5). Note that, from the condition (D3), 



/ (a x + 5)ir(dx) = —a + 5 < —e. 



It now follows from the from the definition @ of k, and since also b > k, that we may 
choose (5 > sufficiently large that 



(of + 6)ir(dx) < -e, (43) 

IX 

a p x +5<b for all x £ X, (44) 
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(where a x is as defined by ©)• Let b x be a measurable function on X such that, for some 
sufficiently large d > 0, 

max(-d, a% + 5) < b x < b, x G X, (45) 
b x Tr(dx) = -e. (46) 

x 

(To see that such a function 6^ exists, note that, from (|4Hj) . we may choose d sufficiently 
large that 

/ max(— cZ, af + 8)ir(dx) < —e; 
Jx 

since also b > — e, we may, for example, satisfy (|45|) and (|46jl by choosing 6 X = max(s, —d, a x + 
5) for the appropriate constant s £ (—d,b).) 

Define, for each n > 1, 

Cn = £n-&X„. (47) 

Note that, conditional on the modulating process X, the random variable £ n has distribution 
function Fx„ where, for each x € X and each y € M, F x {y) = F x (y + Since also 
F 1 £ S C £, the family of distributions (i^, x € X) satisfies the conditions (Dl) and (D2) 
with i 7 replaced by F where F(y) = F{y — d). 

Since also, for each x € X, the distribution F x has mean d x := a x — b x and b x < b, it follows 
that, for f3' = b + [3, 

' \zV-p)F x {dz)<4-b x <-8, (48) 



where the second inequality above also follows from 1)45(1 . Lastly, it follows from the condi- 
tion (D3) and (|4*6|) that, for each x € X, 



/ d x ir{dx) = —a + e < 0. 



The process (5* n , n > 0) given by S n = Y%=i &) f° r each n > 0, thus satisfies all the condi- 
tions associated with Lemma l2~3*| where F is replaced by F, k is replaced by the appropriate 
k with, from (|48|). k < —5, and a is replaced by a — e. Since also the condition F 1 € S 
implies that F 1 € S C C (and that in particular F 1 is tail-equivalent to -F 1 ), we conclude 
that the supremum M of the process (S n , n > 0) satisfies 

IE P{ ™ >y) < (49) 
a-voo p I (y) ~ a -e 

It also follows from (|48|) that the family of distributions (F^ x E X) satisfies the condi- 
tions (jnj) and (jTU|) of Proposition 12. II with F replaced by F, a replaced by 5, and (3 by (3 + b. 
Hence, again since F 1 € S and is tail-equivalent to F x , there exists a constant r such that, 
for all x € X, and for all y, 

P{M >y | X = x) < min (l, . (50) 

Define also the process (S^, n > 0) by S* = f° r n — ^- Let rjo = Sj, Q and 

% = Sj- —Sj, , > 1, be the increments of this process between the successive regeneration 
epochs of the modulating process X. It follows from (|45[) that, for each k > 0, rjk < fofc. 
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For a constant K to be specified below, define Cfc = max(r^, br^ — K) for each k > 0. The 
random variables Cfc are independent for k > 0, and are identically distributed for k > 1; let 
-fC be such that 

£Cfc < 0, fe > 1. (51) 
Note also that Cfc < &7fc for each k > and so, from the condition (D4), 

P(Co > y) = 0(^(2/)), P(Ci > 1/) = o(F(y)), asy^oo. (52) 

Now let M b = sup„> S*. Then 

M fe < sup(6r , ?7o + 6ri, 7? + r/i + 6r 2 , . . . ) 

< K + SU P (Co, CO + Cl, Co + Cl + <2, ■ ■ ■ ) 

<^ + Co + sup(0,Ci,Ci + C2,...)- (53) 

It follows from (|51|) . (|52|) . the independence of the random variables Ck: k > 0, and the 
Pakes- Ver aver b eke Theorem that the last term on the right side of (|53|) has a probability 
of exceeding y which is o(F 1 (y)) as y — > oo. It now follows, from (|52|). (|53jl . the above 
independence and Lemma lA.ll that 

lim P(M>> j) )^ 
y^oo F l (y) 

Finally, note that, for each n, we have S n = S n + S£ and hence M <M + M b . Since M and 
M b are conditionally independent given X, it follows from (|49j). Q5U|) . (|54|) and Lemma lA, 21 
that 

lim P 'l f > "> < E P( "l Mt > »» < -g-. (55) 
?/^oo F : (y) y^co F 1 (y) a — e 

By letting e — > in (|55jl and combining this result with the lower bound given by Lemma f2,2l 
we now obtain the required result. □ 



2.4 Example 

We give here an example to show the necessity of the condition (D4). 

Example 2.1. Let C> Cii i > 1, be i.i.d. non-negative random variables with common distri- 
bution function F. Assume that E( = 1 and that F l € S. 

We take the modulating process X = (X n , n > 1) to be an independent Markov chain on 
Z + = {0, 1, ... } with initial value X\ = and transition probabilities po,o = 0, poj > for all 
j > 1 and, for j > 1, Pj j-i = 1. Define To = and for > 1, = min{n > T^_i : X n = 1}. 
We regard A; > 0, as the regeneration times of the process. Since p\ t o = 1, it follows 
that, for k > 1, the A;th cycle starts at time Tf.-i + 1 in state 0, and further that the cycle 
lengths Tfc = Tfc — T/ t _i, are i.i.d. random variables with a distribution concentrated on 
{2,3, ... } and distribution function G given by G(y) = Ylj<y-iPo,j- Assume further that 
Et\ = 1 + ^2j>i JPo,j < 00 • Then the Markov chain X is ergodic. 

Now define the modulated random walk (S n , n > 0} by Sq = and S n = Y27=i & where the 
random variables & are given by 

6 = Ci - = o) 
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for some constant d > Et\. The conditions (D1)-(D3) are thus satisfied with F as defined 
here, c(x) = 1 for all x, and a = d/Er — 1. 

Since the random variables Q are nonnegative, we have S n > S n -\ for all n such that 
X n ^ 0, i.e. for all n ^ Tk-i + 1 for some k. It follows that 



M :-- 



sup S n 

n>0 



sup 

m>0 



\k=l 



(56) 



where, for k > 1, 



are i.i.d. random variables with common negative mean Et — d. 

For the process (S n , n > 0) here, the constant k defined by © is given k = EC = 1. For 
an arbitrary b < 1, we provide an example when P(br > y) = o(F(y)), but for which 
F l (y) = o(P(M > y)), in each case as y — > oo. Thus in this case the conclusion of 
Theorem 12.21 cannot hold. 

Choose 7 S (0, 1) and suppose that F(y) = e~ yl (for which it is well-known that F l E S). 
Suppose also that P(r > y) ~ e~ cyl as y — > oo for some c G (6 7 ,1). Then it is readily 



checked that P(br > y) 
the distribution H by 



o(F{y)). For any fixed e <G (0, 1) such that (1 — e) 7 > c, define 
= exp 



cy> 



We now have 



P(th >y)>P 



(l-e)7 



<e \/n>y + d)P[T 1 > 



y + d 



Piny 



y + d 



H(y), 



(57) 
(58) 



as y — > oo, where (|57|) follows by the Strong Law of Large numbers, and ()58|) follows since 
H £ £. Since also -ff 1 S 5, it follows from (|5(ij) . (|58j) . and the Pakes- Ver aver b eke Theorem 
(by for example noting that each random variable ipk stochastically dominates a random 
variable ip' k such that P(ip[ > y) ~ H{y)) that 

Finally, since also F(y) = o(H(y)), and so also F I (x) = o(H I (y)), as y — > oo, it follows that 
F : (x) = o(P(M > y)) as required. 

Finally, we remark that while this example may be simplified somewhat by assuming the 
random variables d to be a.s. constant, we have some hope that, for a suitable choice of F, 
we may show the necessity of the strict inequality b > k in the condition (D4). 
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3 Modulated random walk in continuous time 



In this section we consider a continuous-time process (St, t > 0), whose increments are 
independent and modulated by a background process X = (X t , t > 0) with a regenerative 
structure. Analogously to the discrete-time theory, the process is assumed to have jumps 
which are heavy tailed and that St — > — oo as t — > oo. We are again interested in the 
asymptotic form of the tail distribution of the maximum of the process. Many of the 
probabilistic ideas are similar to the ones before. However, we need to define the processes 
carefully and we do so in Section 13.11 We then present the main results in Section 13.21 a 
general result for processes with independent (but non-stationary) increments in Section l3.3[ 
followed by the proofs in Section [3.41 We refer to Kallenberg (2002, Ch. 15) for the theory 
and construction of processes with independent increments. 

3.1 Definitions 

A process with independent increments. We define what we mean by a process 
(St, t > 0) with Sq = 0, independent increments and distribution specified by a triple 

(u(t,-),v(t) 2 ,a(t), t>0). 

First, t i— > a(t) (respectively t i— > v (t) 2 ) is a real-valued (respectively positive) function that 
is integrable over finite intervals. Second, for each t, the quantity v(t, •) is a Borel measure 
on R with u(t, {0}) = and J R (y 2 A |y|) u(t, dy) < oo; also, for each Borel set B, the function 
1 1 — > u(t, B) is integrable over finite intervals. 

Next let $ be a Poisson random measure on M + x R with intensity measure E§(dt,dy) = 
dt p(t,dy). Note that the intensity measure is sigma-finite and so the Poisson random 
measure is well-defined. 

Finally, for each t, let At := / * a(s)ds; let (Wt, t > 0) be a zero-mean Gaussian pro- 
cess with independent increments and varW* = v(s) 2 ds, and, for each t > 0, let Yf = 
J*[o tlxR yi^(ds, dy) — ds u(s, dy)]. Note that the process (Y t , t > 0) is centred so that EY t = 
for all t. Set 

St = A t + Wt + Y t , t>0. 

Thus, S = (St, t > 0) is a process with independent increments (see, e.g., Kallenberg (2002)) 
and, in particular ESt = At for all t. It is not the most general version of a process with 
independent increments, because we assumed that (i) its mean ESt = At exists (ii) the 
functions t i— > ESt, t i— > EW 2 are absolutely continuous, and (iii) the intensity measure 
E&(dt,dy) has density with respect to the first coordinate. (Note that while the assump- 
tions (ii) and (iii) are essentially technical, the assumption (i) is essential; in its absence we 
would need to pursue a different treatment — in the spirit of Kluppelberg, Kyprianou and 
Mailer (2004) and of Denisov, Foss and Korshunov (2004).) 

A modulated continuous-time random walk. Next assume that we are given a regen- 
erative process X = (Xt, t > 0) such that Xt takes values in some measurable space (X, ), 
a measurable real- valued function (a x , x € X), a measurable positive function (v 2 , x G X), 
and a collection of measures (v x (-), x G X), such that x i— > v x (B) is measurable for each 
Borel set B CR. 
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For each sample path (X t , t > 0), define S = (St, t > 0) as being a process generated by 
the triple 

KV), v(*) 2 , a(t)) := (vxt(-), v 2 Xt , a Xt ). 
As above we assume that, for each t, and each Borel set B, 



/ a Xs ds, / v Xs ds, / u Xs (B)ds are a.s. finite, 
Jo s Jo 



(59) 



and that, for each x € X, 



M{o}) = o, f (y 2 A\y\)Mdy) 

JR 



< CO. 



(For example we note that, if is generated by some topology, a sufficient condition for 
(f59|) to hold is that X have cadlag paths and that x i— > a x , etc. be continuous functions. ) 

We can construct this process by considering a family ($> x , x £ ^Y) of Poisson random 
measures on R + x M. with intensity measure 

E<$> x (dt,dy) = dt v x (dy), 

and an independent standard Brownian motion (Bt, t > 0). We set 



W t := [ v Xs dB s 
Jo 



Y t := f [ y[<S> Xs (ds,dy) - u Xs (dy)ds] 
Jo Jr 



S t --At + Wt + Yt. 

We then have that, for each i, the characteristic function of St, conditional on the background 
process X, is 

E[e i0St | X] = exp \i0 f a Xs ds - ^ /* v\ s ds + f ds f v Xs (dy)[e l9y - 1 - idy]\ . 

I Jo 1 Jo Jo Jr J 

We shall refer to S = (St, t > 0) as a modulated continuous-time random walk. We assume 
that we choose a version of S with cadlag paths. (The reader will recognise that, in absence 
of modulation, the last formula is the Levy-Khinchine formula for a Levy process-see Bertoin 
(1998) or Sato (2000).) We shall use the notation AS t for the size of the jump at any time 
t, i.e. 

ASt '■= St — St-. 

We will also need to denote by $ the point process on M + x R with atoms the pairs (t, ASt), 
for those t for which AS t ^ 0, i.e. $(B) := £t:AS t #o l((t, A5 t ) £ B), B e ^(M+ x R). 
Then, conditional on X, $ is a Poisson point process with intensity measure 

x 1) 9 B h £[$(5) | X] = ^ dt v Xt (dy). (60) 
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3.2 Main results 



We assume that the process (St, t > 0) is modulated by a regenerative background pro- 
cess X = (X t , t > 0) as described in the previous section. 

Denote the regeneration epochs of X by < To < T\ < .... By definition, the cycles 
((Xt,Tk-i < t < Tfc), k > 1) are i.i.d. and independent of the initial cycle (X t , < t < To). 
Define to = To, = T& — Tfc_i, k > 1. Then (r^, > 0) are independent and (t^, A; > 1) are 
identically distributed. We assume that Et\ < oo. For each t > 0, let 7Tt be the distribution 
of Xt, and let 7r denote the stationary probability measure 

tt(B) := — £ / 2 l(Jf 4 € 5) (ft, B € ^(^). 

We require the extension of some definitions from distributions to measures. For any positive 
measure v on R, again satisfying the conditions 

K{0})=0, [ (y 2 A\y\)u(dy) < oo, (61) 

we write V(y) := v((y, oo)) for all y > 0. We say that is subexponential, and write v & S, 
if and only if ~ cF(y) as y — > oo for some distribution F € S and constant c > 0, i.e. 
if and only if v has a subexponential tail; we similarly say that v is long-tailed, and write 
z/ € £, if and only if v(y) ~ cF(y) as y — ► oo for some distribution F £ C and constant c > 0. 
Hence here also we have S <Z C. Finally, we define the integrated (or second) tail measure u l 
on M+ \ {0} by V l (y) = V(z) dz < oo for all y > 0. 

The family (v x ,v 2 x ,a x , x G Af) specifying the distribution of (St, t > 0) will be assumed to 
satisfy the following additional conditions with respect to some reference measure vonM 
satisfying (|61|). some measurable function c : <Y — > [0, 1] and constants 7 and t> 2 : 

(CI) Vs(y) < V(y) for all y > 0, s € 
(C2) ^(y) ~ c(x)v l (y) as y — > 00, x£ A', 

/oo 
(1 Ay 2 K(dy) < 7 , x € AT, 
-00 

(C4) t> 2 < f 2 , x G Af, 

(C5) a := — I a x ir(dx) is finite and strictly positive. 
Jx 

Remark 3.1. The conditions (CI), (C2) and (C5) are analogous to those of the discrete-time 
conditions (Dl), (D2) and (D3). The remaining conditions (C3) and (C4) are additional, 
and very natural, uniformity conditions necessitated by the continuous-time environment 
and have no (nontrivial) discrete-time analogues. (With regard to the condition (C3), note 
that the uniform boundedness in x of V^(l) is already guaranteed by the condition (CI); 
the formulation of (C3) as above is for convenience.) Remarks I2.2H2.4I in Section |^1 have 
obvious counterparts here. We further remark that the condition imposed by (C3) on the 
left tails of the measures v x may be weakened at the expense of some additional technical 
complexity. Finally, note that only the restriction of the measure v to \ {0} is relevant 
to the above conditions. 
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As in Section [21 it follows from the above conditions that the process (St, t > 0) then 
satisfies 

S 

— ► —a, as t — > oo, a.s. (62) 

(see the discussion of this result in the Appendix). Hence also St — ► — oo, as i — > oo, a.s., 
and so M := sup t>0 St is finite a.s. 

For each x G A? and /3 > 0, define 

of :=a x - / (y + /3) ^(dy). (63) 



(Here denotes fr^ we use similar conventions elsewhere.) Define also 

k := lim supaf. (64) 

As in discrete time, in the case where the measures v x , x G X, satisfy the uniform integra- 
bility condition 

-j8 



lim sup \ \y\ v x (dy) = 0, 



P- 

it follows from (|63|) and (|M]> that k = sup^g^ a x . Define C G [0, 1] by 



C := / c(x)vr((ix). (65) 

Theorem 13. II below, for the case k < 0, is the analogue of Theorem l2.1l for the discrete-time 
case. 

Theorem 3.1. Suppose that (C1)-(C5) hold, that u l G S, and that k < 0. Then 

y^oo i^ : (?/) a 

For the case where the sign of k may be arbitrary, we again require an additional condition, 
similar to (D4), regarding the (tail) distributions of the lengths of the regenerative cycles. 
The condition here is: 

(C6) For some nonnegative b > k, 

P(br >t) = o(7 l (t)), P(bn >t) = o(V(t)), as t -> oo. (66) 

As in the discrete-time case, for k < the condition (C6) is trivially satisfied by taking 
b = 0, so that again Theorem 13.11 mav be viewed as a special case of the general result given 
by Theorem 13.21 below. 

Theorem 3.2. Suppose that (C1)-(C6) hold and that v l G S. Then 

P(M > y) C 
lim — _ = — . 

y^oo v l (y) a 
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3.3 A uniform upper bound for continuous-time processes with indepen- 
dent increments 



We prove in this section an auxiliary proposition, analogous to that of Proposition 12.11 for 
the discrete-time case, which will be required for the upper bound. 

Proposition 3.1. Let v be a Borel measure on R satisfying (|61|) and such that v l £ S. For 
strictly positive constants a, (3, v 2 , let the process (St, t > 0) have distribution given by 
a triple (vt, v 2 , at, t > 0) satisfying the conditions of Section \3.1\ and such that, for all t, 

My) < v (y) f° r al1 y > o, (67) 

(lAy 2 )u t (dy) < 7 , (68) 

j 

v 2 < v 2 , (69) 

at - (y + P) vt{dy) < -a. (70) 

J — oo 

Let M := sup t>0 5'j. Then there exists a constant r depending only on v, a, (3, 7 and v 2 
such that 

P(M > y) < rV(y) for all y > 0. (71) 

Proof. Consider any process (St, t > 0) with distribution given by (u t , v 2 , a t , t > 0) as 
above. Choose e £ (0, a/2) and y* > sufficiently large that 

u(y*) < e. (72) 

Define, for each t, the measure vf by vf(y) := T^t(y* Vy) — so that vf is the restriction of the 
measure v t to (y*, 00); define also, for each t, the (positive) measure v\ by v\ := v t — — so 
that v\ is the restriction of the measure vt to (— 00, y*]. 

Decompose the process (St, t > 0) as St = Sf + S l t , where Sq = S = 0, the process (5", t > 
0) has distribution given by (vf, 0, — 2e, t > 0), and the process t > 0) is independent of 
(S", t > 0) and has distribution given by (v\, v 2 , a t +2e, t > 0). Define also M u := sup t>0 Sf 
and M := sup t>0 Sj.. Then M u and are independent and 

M<M U + M l . (73) 

We now obtain upper bounds on the tail distributions of M u and M l which, in each case, 
depend only on v, a, (3, 7 and v 2 . 

Define the measure v* concentrated on (y*,oo) by v*(y) ■= v(y* V y) for each y > 0. 
Since, for each t, vf is the restriction of the measure vt to (y*,oo) and similarly v* is the 
restriction of the measure v to (y* , 00), it follows from (|67|) and (|72|) that, for all y > 0, we 
have Vt(y) < z/ *(y) ^ e - Since also = — let for all t, it follows (see Section \'S. If) that we 
may couple the process (S™, t > 0) with a process (S% , t > 0), with 5q = and distribution 
given by the time-homogeneous triple (u*, 0, — e), in such a way that, almost surely, 

< S t * for all t. (74) 

Define M* := sup t>0 -Sj • The process (S%, t > 0) has i.i.d. positive jumps occurring as 
a Poisson process with rate v*(y*) = V(y*) < e, and is linearly decreasing between these 
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jumps (i.e. it is a compound Poisson process with the subtraction of a linear function). Let 
the random variables = to < h < t<z < ■ ■ ■ denote the successive jump times. Then 
the increments £* = 5 t * n — S$ , n > 1, of the process at the successive jump times are 
i.i.d. random variables. Since also, ES^ = —et for all t, we have V{y*)E^\ < —e and so 
E£l < —1. Further the jumps of the process (S* , t > 0) have a distribution G such that 
G(y) = V(y* V y)/V(y*). Since, as observed, the process is strictly decreasing between these 
jumps and since v l £ S C C, it now follows from Lemma lA.31 that the distribution H of £* 
is such that H l (y) ~ G 1 (y) as y — > oo. Hence, by the Pakes-Veraverbeke Theorem, there 
exists r* > such that, for all y > 0, 

P(M* > y) < rV(y). (75) 

We now consider the tail distribution of M , and show that this is exponentially bounded. 
We show how to choose s > 0, depending only on v, a, f3, 7 and v 2 , such that the process 
^e sS *, t > 0^ is a super martingale. For this we require (from the distribution of (Sf, t > 0)) 
that, for all t, 

1 f°° v 2 

- / (e sy -l-sy) u l t (dy) + a t + 2e + ^s<0. (76) 
Define K := max(y*, /3, 1). We now use the upper bound, valid for any s > 0, 
1,™ 1 N / fi(e- s/3 -l-^)<-y-/3 + f S , y<-/3, 



1 - ay) < 



s [se sK y^, -/?<y<y*. 

Since also is the restriction of the measure Ut to (— 00, y*], it follows that the left side of 
(|7S|) is bounded above by 



r-P / B 2 \ f y * v 2 

J [-V-P + y s ) + se ' sK J p y 2 + at + 2e + y s 



(77) 



by (|68|) - (f7fl|) . since, in particular, y 2 < K 2 (l Ay 2 ) on the interval (— /?, y*]. Finally, since 
2e < q, it follows that s may be chosen sufficiently small (and dependent only on u, a, 3, 
7 and v 2 ) that the right side of (|77j) is negative. 

As in the proof of Proposition 12.11 it now follows, by the usual argument involving the 
martingale maximal inequality, that, for s as above and y > 0, 

P(M l > y) < e~ sy . (78) 

Now let C be random variable, independent of all else, which has tail distribution e~ sy . 
From (|7H|). and since M u and M l are independent and (by construction) M u < M* a.s., it 
follows that, for y > 0, 

P{M > y) < P(M U + M l > y) < P{M U + ( > y) < P(M* + (>y). (79) 

Again, as in the proof of Proposition 12.11 it follows from the independence of M* and £, 
(f75|) and J7SJ, and Lemma fA.ll that there exists r, depending only on u, a, (3, 7 and v 2 , 
such that, for all y > 0, 

P(M*+C> y) < r7\y), 
and the required result now follows on using 1)79(1 . □ 
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3.4 Proofs of Theorems ED and EO 



The following Lemma is analogous to Lemma I'i.ll Its proof is entirely similar and so will 
be omitted. 

Lemma 3.1. Suppose that u 1 € C and that d\, d 2 are constants such that d 2 > 0. Then 

r°° i _ 

/ dtv(y + di+d 2 t)~—v l {y) asy^oo. (80) 
Jo «2 

The conditions (CI) and (C2) further imply that 

/ dt Tr t (dx) T^(y + di + d 2 t) ~ —^(y) as y -> oo. (81) 
Jo J x "2 

The following lemma gives an asymptotic lower bound for P(M > y). 

Lemma 3.2. Suppose that (C1)-(C5) hold and that v 1 € C Then 

P{M> y) > c 



y^oo 



Proof. The proof of this is similar to that of Lemma 12.21 Given e > 0, by the weak law of 
large numbers we may choose a constant Iq sufficiently large that if, for each t, we define 
h = h + ( a + £ )t, then 

P(S t > -l t ) > 1 - e. (82) 

Recall that, for each t > 0, St- := lim u j- t S u and AS'j := 5t — Sj_; define also M t _ := 
sup u<t S u . For each fixed y > 0, note that the events 

A t := {M t _ < j/, SV > -it, A5 t > y + l t } 

(defined for all t > 0) are disjoint — since each ^ C {Mj_ < y, > y}. Also, for each 
i, we have At C {M > y}. Further, conditional on the background process X, for each t, 
the events {Mt- < y, $(_ > — ^} and {ASt > y + It} are independent. It follows that, for 

y >o, 

P(M > y) > P (jj = E[l({M t - < y, S t _ > -k})Vx t (v + k)\ dt. (83) 

(To obtain this result, we condition on the first (and only) time t such that = 1, and also 
use the fact that, conditional on X, the intensity measure of the point process introduced 
in Section l3~T1 is as given by (|6U|).) 

Now use the inequality, EIaZ > EZ — cP(A c ), true for a random variable Z such that 
\Z\ < c, a.s., to estimate the integrand in (|83|) as 

E[l({M t - < y, S t - > -Zt})Px7(l/ + /*)] 

> E[vT t {y + k)] - P({M t - > y} U {S t - < -k})V(y + l t ). 
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From this, and l|82jl. we have that, as y — ► oo, 

roc roo 

P(M >y)> E[VT t (y + k)\ dt - [P(M > y) + e] u{y + l t ) dt 
Jo Jo 

= (1 + (1))_ -V(y) - (1 + o(l))[P(M > y) + e]-fl (84) 
a + e a + e 

= a + o(i))^^(y), ( 85 ) 

where (|84|) follows from Lemma l3.1| and (|85j) follows since P(M > y) — > as y — » oo. The 
required result now follows by letting e tend to zero. □ 

We now derive an asymptotic upper bound for P(M > y) in the case k < 0. The proof is 
similar to that of Lemma 12.31 

Lemma 3.3. Suppose that (C1)-(C5) hold, that v l € S, and that k < 0. Then 

y^oo v l {y) a 

Proof. For given (small) e > 0, and (large) no > 0, define the linear function 

u t := u - (a - e)t, t > 0. (86) 

Define the stopping time 

a := inf{t > : S t > u t }. (87) 

Since St/t —* —a a.s., it follows that (for fixed e), 

P(a < oo) —> as u — > oo. (88) 

With regard to random variables such as S a and := maxo<j< CT St which are only defined 
on {<j < oo}, we again make the convention that, for example, P(M a > y) := P{M a > 
y, a < oo). 

We first derive an upper bound for the tail of M a . It follows from (|86jl and (|87|) that 
A/ CT _ < no a.s. on {a < oo}, and further that, for y > no, 

P{M a >y) = P(S a >y)< P(AS a >y-u a ). 

Let <1> be the point process whose conditional intensity measure is given by (|6U|) . Define also 

W = {(t,z) GK+ xi: z>y-ut] (89) 

Note that if a < oo and AS a > y — u a , then (<r, AS a ) € W and hence the point process <3? 
has at least one point in the region W. Combining this last observation with the estimate 
(|S9*|) . we obtain 

P{M a >y)< P{<5>{W) > 0) 

= E[P($(W) > | X)] 

< E[E($(W) | X)} (90) 



/•oo 

£ / 17x7 (y - n t ) 
•/ o 



(it / ir t (dx)v x (y - u t ) (91) 
o w 

f ^(y), (92) 



a — e 



23 



as y — > oo, where follows since 3>(W) is nonnegative integer- valued, and (j92j) follows 
from Lemma 13. II 

Since k < it follows from l|64|) that we can choose any a G (0, — k) and then (5 > 
sufficiently large that 

af < -a for all x G AT. (93) 

On the set {a < oo} define the process (Sf, i > 0) by S% := So-+j — S^; let M a := sup 4>0 S£. 
Conditional on the background process X and any finite value of a, the process (Sf , t > 0) 
has independent increments and is generated by the triple (vx a+t , v\ a ( , ajf ff+i , i > 0). 
Further, it follows from the conditions (CI), (C3), (C4), and (H2B1), that, again conditional 
on X and a, this triple satisfies the conditions (|67 [) - (|70j) of Proposition l3.ll (with v, a, (3 as 
defined here and 7, a 2 as defined by (C3) and (C4)). It therefore follows from Proposition ^, II 
that there exists a constant r, depending on u, a, 0, 7 and v 2 only, such that, for all x, all 
finite t and all y > 0, 

P(M a >y\X = x,a = t)< rV(y)- (94) 

further, conditional on X = x and a = t, the random variables Mo- and M CT are independent. 

For y > no, we have M = S a + M CT = M,j + M° '. We now argue exactly as in the proof of 
Lemma 12. 31 starting from the introduction of the random variable M and with F replaced 
by v throughout, to obtain the required result. □ 

Proof of Theorem This is now immediate from Lemmas 13.21 and 13.31 □ 

Proof of The.ore.n AH.UL This is very similar to, but slightly simpler than, the proof of Theo- 
rem Let nonnegative b > k be such that the condition (C6) holds. Choose 

5 G (0, min(a, b — k)) (95) 

and choose e G (0, a — 5). Note that, from the condition (C6), 

{a x + 5)i:{dx) = —a + 5 < —e. 



It now follows from the definition (|64j) of k, and since b > k, that we may choose (3 > 
sufficiently large that 



(af + 5)7r(dx) < -e, (96) 



af + 6 < b for all x G X. (97) 

Hence (as for example in the proof of Theorem 12 .2|) we may define a measurable function b x 
on X such that, 

oP x + 5 < b x < b, xeX, (98) 

/ b x ir(dx) = -e. (99) 
Jx 

Define now the processes (S\, t > 0) and (St, t > 0) by, for each t, 



S b t = I b Xt , S t = S t -S° t . (100) 
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Note that, conditional on the background process X, the process (St, t > 0) has independent 
increments and a distribution which is given by the triple (vx t -> v x> Q-Xti t — 0)> where, for 
each x, we have a x = a x — b x . It follows from (|99|) that the process (St, t > 0) satisfies the 
conditions (C1)-(C5) with a is replaced by a — e. Further, from the definitions (|63j) . (|64j) 
and the first inequality in (|98f) . the constant k associated this process is replaced by some 
k satisfying k < —5. Since also v l G S, it follows from Lemma 13.31 that the supremum M 
of the process (St, t > 0) satisfies 

E f '^ > /' < (101) 

j/^cxd ^(y) a — e 

It also follows from the conditions (C1)-(C5) and the first inequality in (|98|) that the family 
(vx t , v x , ax t , t > 0) satisfies the conditions (|HTj) - (f70|) of Proposition 13.11 with a replaced 
by 5. Hence there exists a constant r such that, for all x S X, and for all y, 

P(M >y | X = x) < min (l, r~T l (y)) . (102) 

Now consider the process (Sf, t > 0). Recall that the condition (C6) corresponds to the 
discrete-time condition (D4) with F replaced by v. Recall also that (T^, k > 0) is the 
sequence of regeneration epochs of the modulating process X. By considering the discrete- 
time process (S^ k , k > 0), it follows exactly as in the proof of Theorem 12.21 that, under the 
condition (D7), the supremum M b of the process (S£, t > 0) satisfies 

P(M b >y) , . 

lim — i= ^ = 0. (103) 

Finally, since M <M + M b , and since M and M are conditionally independent given X, 
it follows from ifTUTj) . ([TD2|) . (fTUH]) and Lemma EOl that 

_ P(M>rf < ^ F(M + M^) < _C_ m 
?/->oo z^ : (y) y^oo ^(y) a — e 

By letting e — > in ()104|) and combining this result with the lower bound given by 
Lemma l2.2| we now obtain the required result. □ 



A Appendix 

In this appendix we give various general results concerning the addition of subexponential 
random variables. We also justify the generalisations of the Strong Law of Large Numbers 
given by © and (|d^|) . 

Lemma lA.ll below encapsulates the principle of one big jump for subexponential random 
variables. The result (|106j) is standard — see, e.g., Baccelli, Schlegel and Schmidt (1999), 
while the immediately following result follows by standard coupling arguments. 

Lemma A.l. Suppose that F £ S. Let Y\,...,Y n be independent random variables such 
that, for each i = 1, . . . , n, there exists a constant c« > with 

P(Y t > y) ~ aF(y) as y -> oo (105) 
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(where in the case q = this is taken to mean P(Yi > y) = o(F(y)) as y — > oo). Then 

P(Y 1 + ■ ■ • + Y n > y) ~ (c x + • • • + c n )F{y) as y -» oo. (106) 

Further, if, in (|105|) . "~" is replaced by '%" for each i, then (f 1U6|) continues to hold with 
"~ 77 similarly replaced by "< 7; . 

The following lemma gives a version of Lemma IA.1I (for the case n = 2 and with "<" ) 
where the random variables Y\ and Y 2 are conditionally independent. It requires an ex- 
tra, asymmetric, condition (which is automatically satisfied in the case of unconditional 
independence). 

Lemma A. 2. Suppose that F € S. Let Y\ and Y 2 be random variables which are condi- 
tionally independent with respect to some a-algebra T and are such that, for some constants 
c\ > 0, c 2 > 0, and some r > 0, 

P{Yi > y) < CiF(y) asy^oo, i = 1,2, (107) 
P(Yi > y | F) < rF(y) for all y a.s. (108) 

(with the case q = interpreted as in Lemma \A.l\) . Then 

P{Yi +Y 2 >y)< (ci + c 2 )F{y) as y -» oo. 

Proof. Let Y' be a random variable which is independent of Y 2 and such that 

P(Y' > y) = 1 A rF(y) for all y. (109) 

Since F £ S implies F € C, we can choose a positive increasing function /i^ of y such that 
/ij; — s- oo as y — > oo, but the convergence is sufficiently slow that F(y — h y ) ~ F(y) as y — > oo 
(see, for example, Foss and Zachary (2002)). Then 

P(y' + y 2 > y) = P(Y 2 < h y , Y' + Y 2 >y)+ P(Y 2 > h y , Y' + Y 2 > y) 

< P(Y' >y -h y )+ P(Y 2 > h y , Y' + Y 2 > y) 
~rF(y)+P(Y 2 > h y ,Y' + Y 2 > y) as y -> oo, 

where the last line above follows from (|l()8j) and the definition of h y . Hence, since also, from 
(tTUTj) . (tTHHl) and Lemma IA~T1 P(Y' + Y 2 > y) < (r + c 2 )F(y) as y -> oo, it follows that 

P(y 2 > ^, y' + Y 2 > y) < c 2 F(y) as y ^ oo. (110) 

We now have 

P{Yi + Y 2 >y) = P(Y 2 < h y , Y l +Y 2 >y) + P(Y 2 > h y , Y t +Y 2 > y) 

< P(Yt >y-h y ) + P(Y 2 > h y , Y x +Y 2 > y) 

< P(Y 1 >y -h y ) + P(Y 2 > h y , Y' + Y 2 > y) (111) 

< P{Y l >y -h y ) + c 2 F(y) as y -> oo (112) 

< (ci + c 2 )F(y) as y ^ oo, (113) 

as required, where (|111|) follows by conditioning on T , (|112() follows from (jllOj) . and 
follows from ()107j) and the definition of h y . □ 
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Lemma lA.31 below is a variant of a well-known result. 

Lemma A. 3. Let Y\ and Y2 be independent random variables with distribution functions F\ 
and F2 respectively. Suppose that F{ € C and that Y2 > a.s (^2(2/) = for y < 0). Then 
the distribution function F ofY = Y\—Y2 satisfies 

F(y) ~ Fl(y) as y -» 00. (114) 

In particular, F l € C. 

Proof. The result is well-known when F^ and F 1 in the statement of the lemma are re- 
placed by Fi and F respectively — see, e.g., Baccelli, Schlegel, and Schmidt (1999), and the 
modifications required for the present variation are trivially checked. □ 

Finally, we prove the generalisations of the Strong Law of Large Numbers given by (@J and 
(pi). 

Consider first the discrete-time case of Section|2j In the case where the modulating process X 
is stationary (and, by definition, regenerative) then (£ n , n > 0) is a stationary regenerative 
sequence and follows from Birkhoff's theorem (since the invariant <r-algebra is here 
trivial). In the general case, one can always define a coupling of the sequence (£ n , n > 0) 
and of a stationary regenerative sequence (£' n , n>0), such that 

£ Tl +m = £' T > +m a - s - for all m = 1, 2, . . . 

for some non-negative and a.s. finite integer-valued random variable T' — see, for example, 
Thorisson (2000, Chapter 10, Section 3.) Therefore, on the event \T\ < n}, 

and, as n — > 00, 

S n S T'-T 1+ n T' — T\ + n S Tl - S' , 

— = —. — 1 * ~ a a - s - 

n T — T\ + n n n 

since the events {T\ < n} increase in n to an event of probability 1. 
The continuous-time result 1)62(1 follows entirely similarly. 
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